Entropy production in nonequilibrium thermodynamics: a review 
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Entropy might be a not well defined concept if the system can undergo transformations involving 
stationary nonequilibria. It might be analogous to the heat content (once called "caloric" ) in trans- 
formations that are not isochoric (i.e. which involve mechanical work): it could be just a quantity 
that can be transferred or created, like heat in equilibrium. The text first reviews the philosophy 
behind a recently proposed definition of entropy production in nonequilibrium stationary systems. 
A detailed technical attempt at defining the entropy of a stationary states via their variational prop- 
erties follows: the unsatisfactory aspects of the results add arguments in favor of the nonexistence 
of a function of state to be identified with entropy; at the same time new aspects and properties of 
the phase space contraction emerge. 
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I. Thermostats and chaotic hypothesis. 

In studying equilibrium and nonequilibrium thermo- 
dynamics the notion of thermostat plays an important 
role: it is usually defined empirically [1] as a physical 
system capable only of exchanging heat without chang- 
ing temperature or performing work (hence it is ideally 
an infinite system). 

However one can also envisage concrete mechanisms 
to keep a system in a stationary state, realized by a me- 
chanical force of nonconservative nature. Here I want 
to consider mechanical systems which, in spite of being 
acted upon by nonconservative forces, are kept in a sta- 
tionary state by other mechanical forces, and to study 
which relations, if any, can be established between the 
various stationary states, [2]. The transformations be- 
tween the stationary states will be quasi static" trasfor- 
mations through intermediate stationary states. 

I shall consider only systems consisting of many parti- 
cles and I shall not consider systems that are modeled by 
continual because the latter are more complex and can be 
regarded as an idealization in which several many parti- 
cles systems are put together, one per "volume element", 
and studied on time and space scales vastly different from 
the ones we consider for the evolution of the simple sys- 
tems which we imagine to constitute the volume elements 
of the continuum, [3] . Continua can also be considered 
but one first must understand the thermodynamics of a 
simple system, [3]. 

A simple system will be described by a differential 
equation in its phase space: we write it as i = Xe{x) 
where x = {q, q) € R^'^ = SI {phase space), Xe{x) — 
(il_B(a^), 2LEi^))j ^=number of particles, mass of the 
particles m = 1, with 



q^nq)+E-g{q)~dEiq,q)=XE{x) 

where f (q) describes the internal (conservative) forces 
{e.g. hard cores), E_ ■ g{q) represents the "external 
forces" (nonconservative) acting on the system, with E_ 
being their "strength" : for definiteness we suppose that 



they are locally conservative (like an electromotive force) 
but not globally such, and ^ is the force law which 
models the action exerted by the thermostat on the sys- 
tem to keep it from indefinitely acquiring energy: this is 
why I shall call it a mechanical thermostat. Linearity in 
E_ does not mean that I am assuming the forces to be 
small (the theory of linear nonequilibrium is amply dis- 
cussed in the literature, [4]): in any event the response 
curves of forces versus fluxes will be non linear evenfor 
the abobe model. 

More generally the external forces could be velocity de- 
pendent and even periodically time dependent: we first 
restrict to positional forces for simplicity. Velocity de- 
pendent forces should also be considered as they are nec- 
essary to study heat conduction problems: this will be 
briefly discussed in Sec. VI. 

Assumption (chaotic hypothesis, [5]); The system evo- 
lution is assumed to be "as chaotic as possible", i.e. it is 
assumed to be hyperbolic. 

Technically I mean that the system is supposed to be 
"a transitive Anosov system", [3, 6]. 

We shall denote temperature by to avoid confusion 
with time which will be often denoted T. Models of ther- 
mostats in the above sense can be very different even for 
the same macroscopic system; for instance (a list far from 
exhaustive) 

(1) assuming the system to have hard cores one can 
suppose that the collisions are inelastic: the head-on 
component of the energy is decreased by a scale factor 
rj < 1 upon each collision or, alternatively, the total 
energy of the two colliding particles is rescaled and as- 
signed a given value 3^3 0. This kind of thermostat has 
been first introduced and applied in "Drude's electrical 
condution model" to model the thermostatting effects of 
the collisions electron-phonon by Drude and, later, by 
Lorentz, [7]; or 

(2) assuming that there is a background friction i?; = 
—vqi, ly > 0, for all components of qj; or 

(3) assuming least effort to keep, say, the total kinetic 
energy or the total energy constant, {^^ Gaussian thermo- 
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star, [8]). 

Stochastic thermostats could also be allowed (they just 
add degrees of freedom to the equations) but we do not 
consider them here, [9-12]. 

II. SRB statistics and nonequilibrium ensembles 

Any initial state x, randomly chosen in phase space 
with a probability distribution which has a density in 
phase space (in jargon "absolutely continuous distribu- 
tion with respect to Liouville measure"), will admit a 
statistics (under the above chaotic assumption): i.e. for 
all (smooth) observables F 

lim i r F{Stx)dt= I liE{dy)F{y) (1) 

where is a stationary probability distribution on 
phase space, called the SRB distribution or SRB statis- 
tics, [3, 6, 13, 14] . 

Definition: A system in a microscopic state x which 
has SRB statistics he is said to be in the stationary 
state II E ■ The collection of all stationary states of a 
system that are constructed by varying the parameters 
(typically the volume V of the container, the particles 
number N, the external forces E_, etc) will be called a 
"nonequilibrium ensemble" . 

Remark: Hence here an ensemble is a collection of proba- 
bility distributions although, often, established terminol- 
ogy indicates an ensemble to be a single element of the 
collection: according to the above definition we would 
simply call, in equilibrium cases, "micro canonical ensem- 
ble" what with th(> usual teminology is called "the collec- 
tion of the microcanonical ensembles as the parameters 
V, U vary" . The latter circumvolution being in my view 
too awkward I have adopted calling an ensemble already 
the whole collection of distributions (as the French word 
ensemble literally suggests). 

The notion of nonequilibrium ensemble is wider than in 
equilibrium as it depends also on the equations of motion, 
hence on the thermostat model. Therefore one expects 
that, as it happens in equilibrium statistical mechanics, 
there should be "equivalent ensembles" corresponding to 
classes of different meaningful models for thermostats 
acting on a system, see [3, 6] and appended references. 

Equilibrium is a special case of nonequilibrium: in such 
case E = and i? ^ = and the chaotic hypothesis 
implies the validity of the ergodic hypothesis and the 
family of SRB distributions can be parameterized by to- 
tal energy U and volume V and coincides with the mi- 
crocanonical ensemble, [6] . 

We now want to consider which relations can be es- 
tablished in general between the properties of station- 
ary states that can be transformed into one another by 
changing the external parameters. 

If we limit ourselves to equilibrium states then it is 
well known since Boltzmann (in his papers in the period 



1866-1884, see [15]) that if a transformation generates an 
energy variation dU and a volume variation dV when the 
pressure (defined microscopically) is p and the average 
kinetic energy is ^NksQ then, [6], 

dU + pdV 

— = exact 

while dU + pdV is not exact, except in the isochoric case 
{i.e. when dV = 0), and it is called the heat transferred 
from the reservoirs to the system. It makes no sense to 
talk of amount of heat contained in the system unless 
one limits oneself to studying isochoric transformations: 
there is no caloric {i.e. no heat content, see [16, 17]) un- 
less one allows only the latter type of transformations in 
which the system performs no work (and in that case it 
is just another name for internal energy). 

Defining entropy as a primitive of the exact differential 
{dU + pdV)/Q, the first immediate question is whether 
one can extend the notion of entropy content to non equi- 
librium states. 

III. Entropy production and temperature. 

The proposal that emerges from recent literature 
(mostly based on numerical experiments), [6, 8, 18, 19], 
is to define, if ks is Boltzmann's constant. 

Definition: The entropy production rate s in a station- 
ary state He is s = kscr with 

a = fiE {dx) a{x) 
Jn 

where a{x) = — divergence of X e {x) and fiE is the SRB 
statistics. 

Note that a is also the average value over time of the 
phase space contraction, by (1). 

An important general theorem, [20] , guarantees that 
cr > 0, and tr = corresponds to the case in which the 
SRB distribution /i_E admits a density on phase space, 
a case that one naturally identifies with an equilibrium 
state and which essentially happens only if ^ = . 

The above definition leads to a natural definition of 
temperature of the thermostatting forces, [2, 21]: note 
that there is no universally accepted definition of tem- 
perature in systems out of equilibrium, even if stationary. 
Namely one sets 

Definition: the effective temperature © of the ther- 
mostats equilibrating the external forces keeping a system 
in a stationary nonequilibrium state is 

6 = ^ 

s 

where W is the work per unit time done on the system by 
the external forces and s is the entropy production rate. 
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A connection between temperature and entropy pro- 
duction has been already hinted and even used in the 
literature ([21, 22] and F. Bonetto) and alternative defi- 
nitions have been proposed, see [23]. 

The above definition does not make sense as such in 
equilibrium because it becomes 0/0: however one can 
imagine introducing a small forcing and a corresponding 
thermostat. Then in the limit of vanishing forcing this 
yields a definition of 8 which by the "fluctuation dissi- 
pation theorem" would be correct, [22, 24-27]. 

A natural question is whether the above definition of 
temperature is related to heat transfer: docs a heat cur- 
rent arise when two systems at different temperature in 
the above sense are thermaly connected {i.e. are made 
to interact)? The question is difficult and an example in 
which the answer is affirmative in discussed in Section 
VI, along the lines of [24]. 

Adopting the above concepts leads naturally to giving 
up the possibility of defining entropy content of a system: 
in nonequilibrium thermodynamics entropy ends up to be 
undefined and one can speak only of "entropy produc- 
tion" or "transfer" : much as "caloric" or "heat content" 
is undefined in equilibrium thermodynamics. Should one 
insist in defining the entropy content of a dissipating {i.e. 
with cr > 0) stationary state one would be compelled to 
assign to it a value —oo, because the system cedes en- 
tropy at a constant rate. 

IV. _ff-functions. 

The above is not in contradiction with the possibility 
of existence of a function which, given an initial state 
X, will evolve monotonically until reaching a maximum 
value, the same for almost all x in phase space, [28-30]: 
and this is not in contrast with microscopic reversibility. 
For instance in the case of the evolution of a rarefied gas 
we can imagine to divide the one particle phase space into 
cells C, "of appropriately chosen size |C|", [28], and call 
fc{x) the occupation number of each cell by the particles 
in X. Then, if t ^ Stx denotes the time evolution of the 
initial data x at time t, 

I y^fc{SrX)\0gfc{SrX)dt 
t Jo c 

will converge, and for practical purposes monotonically 
after a short transient, as t — » cxd to a limit which, if 
the Boltzmann equation holds within a good approxi- 
mation, maximizes —kB^(j Pc^ogpc ^ Pc ^ Oj (subject 
to the conservation constraints like "^qPc — N, etc., 
[28]) and the limit value is given by the entropy S of 
the equilibrium state associated with x. If Boltzmann's 
equation is (unreasonably) dismissed then still the above 
quantity will converge to essentially the same limit but 
the time average will be important as the integrand will 
not "really converge" to S but it will show very rare 
large fluctuations which, however, are as a rule doomed 
to occur at time intervals larger than the age of the Uni- 



verse, i.e. do not occur at all for "all" purposes (I suppose 
that the number of particles of the system is large, say 
> 10^): neglecting such impossible events would in fact 
dispense from considering the time average in the above 
limit relation. However it is not clear that there should 
be a universal definition of such " Lyapunov functions" or 
"H -functions" . I think that they can certainly be defined 
on a case by case basis but not necessarily in a general 
universal way: for instance in fluids of higher density in 
the last formula one should use the Resibois i?-function, 
[31]; and this is so, I think, essentially because one can- 
not dcflne an entropy content for non equilibrium states: 
which is the quantity that would, otherwise, naturally 
play the role of a universal iJ-function. 

Note however that other views arc possible if entropy 
and heat are conceptually separated: this is discussed in 
Sect. V. 

V. Coarse graining and counting phase space 
cells when volume is not conserved 

Recently a quite general and universal definition has 
been proposed identifying the iJ-function with the log- 
arithm of the volume occupied in phase space by the 
phase space points which are macroscopically indistin- 
guishable {i.e. "defining the same macrostate"): this ap- 
plies when the notion of macrostate is free of ambiguities 
(or at least one can resolve them), and it is certainly an 
interesting proposal which has already received support 
from numerical experiments, [30]. The value S of this 
quantity could be an interesting definition of entropy of 
the stationary state that is eventually achieved by the 
evolution of all phase space points that correspond to 
the same macrostate. Although S might be unrelated to 
the amounts of heat that are transferred in the transfor- 
mations between stationary states, calling it "entropy" 
would be justified on the basis of its coincidence with en- 
tropy in the case of equilibrium states and of its nature 
as a Lyapunov function for the approach to stationar- 
ity. The question of the dependence on the notion of 
macrostate that is used is still somewhat incompletely 
understood, however. 

The problem, and the difficulty, of defining entropy can 
be studied also from another viewpoint not unrelated to 
the latter one because it also tries to give a precise def- 
inition of coarse grained description of the phase space 
points: the attempt (whose outcome I do not consider 
satisfactory for the purpose of defining entropy of sta- 
tionary states) is to identify entropy with the number of 
phase space cells "relevant" at given external parameters, 
taking advantage of a variational principle for the SRB 
statistics and interpreting it as an equidistribution prop- 
erty in phase space. The discussion will be performed 
at a level more technical than that of the previous sec- 
tions for the purpose of examining the proposal in detail, 
following [32]. 

For simplicity I suppose a discrete time dynamics 
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described by a hyperbolic map S (with dense trajec- 
tories: chaotic hypothesis) on a bounded surface fl 
{phase space). Briefly we call the dynamical system 
(fi, S) an Anosov m,ap: for a general discussion see [19]. 
As in the continuous time case this implies that, ex- 
cept for a volume zero set of initial data x, it will be 
Mmr^ooT-^EjJ PiS'x) = j iJ.sRB{dy)F{y) for all 
continuous functions {observables) F on fl. 

The SRB distribution admits a rather simple represen- 
tation which will be interpreted here in terms of ^^coarse 
graining'^ of the phase space. In fact given a partition of 
phase space into closed regions V = {Pi, . . . ,Pm) with 
pairwise disjoint interiors, consider a point x in phase 
space which is not in the set B of zero volume consisting 
of the points that in their evolution fall on the common 
boundary of two Pi's. Then we can define the history 
of X on V, i.e. a sequence ^ such that S''x G P^,^. The 
sequence ^ must verify the property, called com,patibil- 
ity, that Qs.k,ik+i — ^ times k where the matrix 

Q is defined to be Q^,^' = unless there is an interior 
point in P^ whose image is in the interior of P^r. in the 
latter case Q^.^' = 1. The matrix Q just tells us which 
sets P^' can be reached from points in in one time 
step. Then for Anosov maps one can find a partition (in 
fact infinitely many) of phase space V = {Pi, . . . , Pm) so 
that, [3, 6, 33-39], 

(1) if ^ is a compatible sequence then there is a point 
X such that S''x £ P^,^, see (for instance) Ch. 9 in 
[6], {'' com,patibility" ) . The points x outside the excep- 
tional set B (of zero volume) determine uniquely the cor- 
responding sequence ^ . 

(2) the diameter of the set of points E{^_ij^, . . . ,S,^t) 
consisting of all points which between time —^T and 
visit, in their evolution, the sets Pj. is bounded above by 
ce"*^^ for some c,k>0 {i.e. the code ^ — > a; determines 
X "with exponential precision"). 

(3) there is a power k of Q such that Q^^, > for all ^, ^' 
{"transitiviti/^). 

Hence points x can be identified with sequences of sym- 
bols ^ verifying the compatibility property and the se- 
quences of symbols determine with exponential rapidity 
the point x which they represent. The existence of V is 
nontrivial and rests on the chaoticity of motions. 

Given a finite string ^ = (Ca,Ca+i, ■ ■ ■ ,^b) we define, 
more generally, the set E^^ to be the set of points x in 

phase space such that S^x & P^^ ior j = a,a + 1, . . . , b. 

Given a point x the set of points whose history co- 
incides with that of x for all > large enough deter- 
mines uniquely a smooth invariant surface Eg {x) through 
X called the stable manifold of x and likewise the set of 
points whose history coincides with that of x for all —k 
large enough determines uniquely a smooth invariant sur- 
face Eu(x) through x called the unstable manifold of x. 
Points y G Ss(x) have a behavior in the future very simi- 
lar to that of X and in fact the distance between S'^y and 



S'^x is bounded by Ce~^^ for C, A > suitable. Likewise 
points y G E^(a;) have a behavior in the past very similar 
to that of X, the distance between S~''y and S~''x being 
bounded by Ce~^^ . 

The expansion and contraction that take place near 
every point x can be captured by the matrices dSu{x), 
dsS{x) obtained by restricting the matrix {Jacobian ma- 
trix) dS{x) of the derivatives of S to its action on the 
vectors tangent to the unstable and stable manifolds 
through x: S maps T,u{x),T,s{x) to T,u{Sx),T,s{Sx) and 
its derivative maps the tangent vectors at x into tangent 
vectors at Sx while dSu{x), dsS{x) map tangent vectors 
to T,u{x),Y,s{x), respectively, to corresponding vectors 
tangent at Sx. 

A quantitative expression of the expansion and con- 
traction is given by the "local expansion" or "local con- 
traction" exponents defined by 

Au{x)= log|det(a5)„(x)|, 

A,{x)= log\det{dS)s{x)\ (2) 

Then the SRB probablilities and the normalized volume 
(or "normalized Liouville measure" ) are measures on the 
sets E cO, which are described in terms of the functions 
Au{x), As{x). Their description is quite simple. 

The exponential contraction in the past or in the future 
along the unstable and stable manifolds, consequence of 
the hyperbolicity assumption, implies that the diameter 

def 

of the phase space subsets j = E^_^^^^,,,^^^^^ tends to 
zero exponentially fast (and uniformly in the choice the 
string ^ ) as T ^ oo. 

Given T > the collection of the non empty sets 
.?T/2 t)e used to study the properties of a 
restricted class of observables, namely those which have 
essentially constant values on such small sets. Let T be a 
time such that the size of the (nonempty) sets of the form 
-^5-t/2,. ->£t/2 is so small that the few physically interest- 
ing observables can be viewed as constant inside each 
^i-T/2,--;iT/2 = ■ We define, if Q is the compatibility 
matrix, 

Definition: (Coarse graining^ The sets of points of the 
form E^ = £'{_r/2,---iCT/2 '^^^^ called the elements of 
a description of the microscopic states "coarse grained 
to scale 7 " if 7 is the smallest linear dimension of the 
nonempty sets £'{_t/2,---,Ct/2 ■ ^^^^ elements E(^ of the 
"coarse grained partition of phase space" are labeled by a 
finite string 

C = {^-T/2, ■ ■ ■,^T/2) 

with ^i = l,...,m and = 1- 

Define the forward and backward expansion and con- 
traction rates as 

±T/2 ±T/2 
j=0 3=0 
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and select a point x{(_) E for each . Then the SRB 
distribution jigRB and the volume distribution /Ul on the 
phase space fi, which we suppose to have volume W = 
V{ri), attribute to the nonempty sets the respective 
probabilities n^jiL 

Ki)'= l^SRB {E^_ ) and ML ( i ) =^ (3) 

if V{E) denotes the Liouvillc volume of E. The distribu- 
tions /U, /XL are shown to be defined by 

M.(i) = /^i:JO-e(^=^-(^(i»-<^+^(^(i») (4) 

and h^^{^), /iJ„(C) arc suitable functions of ^, uni- 
formly bounded as ,T vary, which are mildly dependent 
on ^ ; so that they can bo regarded as constants for the 
purpose of the present discussion, cfr. Ch. 9 in [6],. 

The (4) shows that the Liouville volume weights asym- 
metrically the past and the future while the SRB distri- 
bution weighs them symmetrically. One can say that the 
expansion and contraction rates A„,As provide an "en- 
ergy function" that assigns relative probabilistic weights 
to the coarse grained cells via (4). 

The latter analogy provides the motivation for the 
name "thermodynamic formalism" that is often given to 
the mathematical theory of chaotic systems, [40]. 

As mentioned above we have in mind that the sets 
-Bj represent macroscopic states, being small enough so 
that the physically interesting obscrvablcs have a con- 
stant value within them; and we would like to think that 
they provide us with a model for a coarse grained^ de- 
scription of the microscopic states. The notion of coarse 
graining given here is precise and, nevertheless, quite 
flexible because it contains a free "resolution parame- 
ter" 7. Should one decide that the resolution 7 is not 
good enough because one wants to study the system with 
higher accuracy then one simply chooses a smaller 7 (and 
correspondingly a larger T). 

The phase space volume will generally contract with 
time: yet we want to describe the evolution in terms of 
evolution of microscopic states, with the aim of count- 
ing the microscopic states relevant for a given stationary 
state of the system. 

Therefore we divide phase space into parallelepipedal 
cells A of side size e ^ 7 and try to discuss time evolution 
in terms of them: we shall call such cells "microscopic" 
cells as we do not associate them with any particular 
observable; they represent the highest microscopic reso- 
lution. 

One can think of the new microscopic cells as physical 
realizations of objects that arise in computer simulations: 

in the simulations cells A are the "digitally represented" 
points with coordinates given by a set of integers and 



the evolution S' is a program or code simulating the solu- 
tion of equations of motion suitable for the model under 
study. The code operates exactly on the coordinates (the 
deterministic round offs should be considered part of the 
program). The simulation will produce (generically) a 
chaotic evolution "for all practical purposes", i.e. if we 
only look at "macroscopic observables" which are con- 
stant on the coarse graining scale 7 = e~i^"^i?o of the 
partition 'P'^, where £0 is the phase space size and A > is 
the most contractive line element exponent (which there- 
fore fixes the scale of the coarse graining, by the definition 
above). 

A few words must be said about the precise meaning 
of "linear sizes" : in fact we are considering partitions of 
phase space into sets ignoring that the coordinates have a 
physical meaning. Some of them are momenta and others 
are positions hence they have different physical dimen- 
sions. Therefore, assuming that we consider N mass-m 
particles in a gas at average kinetic energy per particle 
Ifc^Oo (note that Oq will in general be different from the 
temperature Q defined in Sec. Ill) and numerical density 
p, we imagine to measure such quantities in terms of units 
6q of length and Sp of momentum fixed a priori, subject 
to the constraint that they should be (following the re- 
currence times estimate made by Boltzmann, p. 400 in 
[41], see also [6]) much smaller than, respectively, p"^ 
and V2toA;b6o. Then W = with £0 proportional to 
{p-^/^V2mk^/Sp6qy/'^: i.e. if d = 6N is the phase 
space dimension, it is 

The question we ask on general grounds is, see also [42] 

Question: can we count the number of ways in which the 
asymptotic state of the system can be realized microscop- 
ically? 

In equilibrium the (often) accepted answer is simple: 
the number is A/q = W/e'^, i.e. just the number of cells 
("ergodic hypothesis"). This means that we think that 
motion will generate a one cycle permutation of the Afo 
cells A, each of which is therefore, representative of the 
equilibrium state. Average values of macroscopic observ- 
ables will be obtained simply as: 

limt^ooi-^E*=o^(^'^) = 
= A/'o"'EA^(A) = /oi^(y)ML(dy) 

According to Boltzmann the quantity: 

SB''=kB l0g(>V/£'^) 

is then, see [43], proportional to the physical entropy of 
our equilibrium system. 
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Can one extend the above view to stationary systems 
out of equilibrium? In such systems the volume will no 
longer be preserved by time evolution and, in fact, its 
contraction rate 

r/(,x) = -logldetaS-Cx)! 

not only does not vanish but, in general, will have a pos- 
itive time average rj, 




see [20]. If > the volume will contract indefinitely 
(hence the system will be called dissipative) . 

Out of equilibrium we may imagine that a similar kind 

of "ergodicity" holds: namely that the cells that repre- 
sent the stationary state form a subset of all the cells, on 
which evolution acts as a one cycle permutation. 

If so the statistical properties of motions will be de- 
termined by the equidistribution among such cells, which 
therefore attributes probabilities p(A) which maximize 
the quantity — p(A) log/9(A). Hence the above 
counting question can be related to a problem 

... which necessarily follows from Boltmann's train of 
thought, [and] has remained untouched. Consider an ir- 
reversible process which, with fixed outside constraints, is 
passing by itself from the nonstationary to the stationary 
state. Can we characterize in any sense the resulting dis- 
tribution of states as the "relatively most probable distri- 
bution", and can this be given in terms of the minimum of 
a function which can be regarded as the generalization..., 
[44], footnote 239, p.l03. 

Considering realizations, and even simulations, of a 
dissipative system we must recognize that no represen- 
tation of the evolution as a map of the phase space cells, 
nor any code in simulations, can be invertible: it must 
happen (many times) that SA = SA' with A ^ A'. 
Clearly if SA = SA' = A we can think that both A and 
A' are not really different and only one of the two should 
be taken as a representative of a microscopic state. 

We can imagine "pruning" one after the other the 
"unnecessary" cells until the map S becomes invertible. 
More formally each cell A will have a motion that is even- 
tually periodic and we discard as ^'transients" all cells 
whose evolution is not strictly periodic. We identify the 
remaining "non transient" cells as the cells which "are 
on the attracting set" and which form a discrete model 
of the attracting set for the motions. Correspondingly 
we say that a coarse grained cell is "in the attracting 
set" if it contains non transient cells. 

The question posed above becomes now a precise one: 
which is the number of left over cells? It will be only 
a fraction of the initial number jVq of cells: and we can 
attempt to estimate it. 



However we must take into account that the time T is 
far smaller than the time necessary to resolve the phase 
space cells. Since the length of time necessary to resolve 
points in phase space with precision 7 is T and since we 
assiime that we shall be finable to see cells with a preci- 
sion higher than 7 then phase space contraction implies 
that the number J\f of phase space cells necessary to de- 
scribe the motions with an accuracy 7 is 

J\f = Moe-'^^ (5) 

because in time T the phase space volume is reduced by a 
factor about e"'^'' (here ^ which should be identified with 
the infinite time average rj of the phase space contraction 
rate — log | det dS (x) | ) . In fact our observations require 
the phase space cells to maintain a well defined identity 
at least for a time duration T and they cannot be more 
than the r.h.s. of (5). This means that we imagine that 
if we make observations with precision 7 only cells in a 
layer of width 7 around the attracting set will be involved 
in the decription of the motion: cells further apart are 
non recurrent (aperiodic). 

We could from now on take 7 = e and the analysis 
would be simpler: it is however interesting and impor- 
tant to consider also the cases 7 > £ because the ex- 
tremely large size of the recurrence times on the micro- 
scopic scales makes it not physically meningful to discuss 
phenomena occurring on the recurrence time scale. 

The picture must hold for all Markovian pavements V 
and for all T's such that 7 = e~2^'^5 > e if 5 ~ €0 is the 
typical size of an element of the partition V: this induces 

to choose T to be of the order of T = 2A log £0/7- 
And, as in equilibrium, once that T is so chosen and the 
requirement 7 > e is fulfilled, we shall think that all cells 
evolve in time so that they visit all other Af cells. 

This is a kind of "ergodicity" assumption which is sim- 
ilar to the corresponding assumption that in equilibrium 
all cells are actually visited. Note that assuming that 
only a fraction of them is visited (hence N < Aoe"-^) 
is also possible and, nevertheless, it would give the same 
statistics as long as the fraction is taken to be the same in 
each coarse grained volume, but it would give a different 
cell count: if we are unable to probe phase space with 
precision higher than 7 and 7 > e we cannot distinguish 
the two possibilities and taking the equal sign in (5) can 
only be a simplicity assumption which however comes 
with the warning that the cell count might be somewhat 
ambiguous unless 7 = e. The same ambiguity is also 
present in equilibrium cases. 

Therefore the SRB distribution attributes the same 
weight to all cells A on the attracting set and therefore 
it verifies a variational property: namely if C is a generic 
cell and n{C) is its probability in a statistical state of 
the system then — J^c ^i^) logn(C) attains a maximum 
when n{C) = Af-^ 

It is interesting that the latter property can be identi- 
fied with the variational principle for SRB distributions, 
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[42]. Indeed from the general theory of the SRB distri- 
butions, see [33, 34, 37, 45] and [6], Chap. 9, we know 
that the SRB distribution gives weight 6"^"'"^'-^ with 

Uu,t{^) = X]Ji-'i/2 ^'-'S^"('^"''^(^))' *° collection 
of all cells A G . Therefore the number of cells in 

the set will be proportional to jVe"*^"'^*---*: which 
implies that the equal weight distribution on the micro- 
scopic cells induces a weight on the coarse grained 
sets E^ which maximizes 

subject to^^pj = l,p{ >0 and with the sums running 

over the ^ 's. This is one of the characterizations of the 
SRB distribution {variational principle of Ruelle, [3, 6, 
14]). 

Coming back to the cell count we take Af = A/qC '^^ , 
see (5), i.e. we suppose that if we probe phase space with 
a precision 7 then all cells closer than 7 to the attracting 
set are visited by the motion. Call — , At the Lyapunov 
exponents, Af > 0, so that A = maxjj(A^, At) and r] = 

T,tiK - ^t)- Keeping in mind that ^ = J\f^ and (5) 
we define 

Scells = kB \ogU= kB (logAAo_- f log ^) = 

= kB{l- f ) logAAo + f log(^)'' (7) 

(note that > is implied by the Sceiis > with 

£ = 7: this is an inequality which seems to be satisfied 

in the examples studied in the literature). The Sceiis 
will change if e/7 vary, as any choice {e.g. £ = 7) of 
the size of cells of the microscopic description is clearly 
arbitrary, and, unlike the equilibrium case when rj = 0, 
the change will be nontrivial, i.e. it will not simply be an 
additive constant independent on the state of the system. 
In fact ri/\ is a dynamical quantity and changing 7 {i.e. 
changing the coarse graining resolution keeping e fixed) 
will change Sceiu as ^Sceiu = ^bc^ if log 

Given a precision 7 the quantity Sceiu measures how 
many "non transient" phase space cells must be used to 
obtain a faithful representation of the attracting set and 
of its statistical properties on scale 7. Here by "faith- 
ful" on scale 7 we mean that all observables which are 
constant on such scale will show the correct statistical 
properties, i.e. that cells of size larger than 7 will be 
visited with the correct SRB frequency. 

Note that we are assuming that the system has a dense 
attactor (sec the above "transitivity" property); so that 
the estimate in (7) holds only as long as this is a correct 
assumption: at high forcing the attracting set is likely 
{i.e. examples abound) to be no longer dense on phase 
space and the number A/o will have to be replaced by a 



smaller power of ^0, affecting correspondingly the analy- 
sis leading to (7): we do not discuss this point here. 

(i) Although eq. (7) gives the cell count it does not seem 
to deserve to be taken as a definition of entropy for sta- 
tionary systems out of equilibrium, not even for systems 
considered here, i.e. simple enough to admit an Anosov 
map as a model for their evolution. It appears as a notion 
distinct from what has become known as the "Boltzmann 
entropy", [28], see also [46, 47], because it depends on 
the value of 7, £ in a nontrivial way. The notion is also 
different from the Gibbs' entropy, to which it is equiva- 
lent only in equilibrium: in nonequilibrium (dissipative) 
systems the Gibbs' entropy can only be defined as —00 
and perpetually decreasing; because in such systems one 
can define the rate at which ( Gibbs ') entropy is "created" 
("ceded to the thermostats") by the system, to be 77, i.e. 
to be the average phase space contraction rJ, see [18, 19]. 

(ii) We also see, from the above analysis, that the varia- 
tional principle that determines the; SRB distribution can 
be identified with the one that leads to equal probability 
of the phase space cells, cfr. (6). The SRB distribution 
appears to be the equal probability distribution among 
the N cells which are "not transient" or, as we say above, 
"are on the attracting set". In equilibrium all cells are 
non transient (if ergodicity is assumed) and the SRB dis- 
tribution coincides with the Liouville distribution. 

(iii) If we could take T — > 00 (hence, correspondingly, the 
resolution 7 — !■ 0) then the distribution fi, which is uni- 
form inside each E^^ but which attributes a total weight 
to E^ equal to N{^) = i^srb{E( )N', would become the 
exact SRB distribution. However it seems conceptually 
more satisfactory, imitating Boltzmann, to suppose that 
7 is very small but > so that T will be large but not 
infinite. 

(iv) By construction the quantity Pg is a maximum as a 
function of the quantities when they have the value 
of the SRB distribution, but it makes sense as a function 
defined on any probability distribution over the micro- 
scopic cells A. In particular if the initial state is a single 
cell one can define {t) as the fraction of time the cell 
has spent in its evolution up to time t inside E^ . There- 
fore the r.h.s. of (6) evaluated with = P({t) tends 
in the average to a maximum and it can be regarded as 
another instance of an Jf-function in the sense of Section 
IV. 

(v) By Pesin's formula the leading term as T ^ 00 of Pb , 
(see (6)), is 0; hence the quantity Pb which makes sense 
for any probability distribution p| will be a Lyapunov 
function for the approach of a probability distribution to 
the SRB distribution but its value can hardly be taken 
as a definition of a property of the stationary state. 

(vi) Let e <C 7. If we identify a microscopic initial state 
with one of the phase space cells then we can consider 
the evolution of the probability distribution which at- 
tributes initial weight to all cells but the ones C in the 
coarse grained region E^ , and equal weight to the lat- 
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tcr ones. Then calHng pc{t) the fraction of time the cells 
initially in Ec spend in the cell C we see that the quan- 

-0 

tity S{t) = - J^cPcit) log PC (0 tends to Sceiis (because 
Pc{t) tends to J\f^^). Therefore S is a general Lyapunov 
function, but it depends non trivially on arbitrary pa- 
rameters (except in the equilibrium case). The (7) also 
shows that there is a direct relation between the number 
of phase space cells and the entropy production rate rj. 
(vii) The analysis in terms of cells is reminiscent, in fact, 
of the methods employed to study Hausdorff dimension, 
the Hausdorff measure and Pesin's formula in general hy- 
perbolic systems, [48]. A deeper understanding of the 
analysis appears to be linked to an important question, 
raised by Ruelle, asking whether (and how) one could 
possibly relate an entropy notion to the logarithm of the 
Hausdorff measure of the attractor (mathematically the 
attracting set is the closure of the attractor, and the lat- 
ter is a set of smallest Hausdorff dimension but still with 
SRB probability 1). A pertinent possibility is that the 
Hausdorff measure on the attractor is absolutely contin- 
uous with respect to the SRB measure. 

VI. Generalities on heat transfer. 

More generally one is interested in cases in which the 
external forces depend also on velocities. This becomes 
necessary if one wants to study the details of heat transfer 
processes. Heat transfer might occurr even in situations 
in which the only forces acting are due to thermostats. 
Therefore we extend the problems of the previous sec- 
tions to more general cases in which forces may depend 
on velocities so that there is no longer an obvious distinc- 
tion between external forces and thermostat forces and 
we are free to call certain forces active forces and others 
thermostat forces. Nevertheless in concrete cases it will 
be often natural to give such attributes to various terms 
into which forces can be decomposed. 

In fact typically the external forces will be positional 
forces while the thermostats forces will be modeled so 
that they can be decomposed as sums 
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9) 



(8) 



with i l , q) 7^ only if q . ^ Ap and Ai , . . . , A„ are 

n disjoint spatial regions. The regions A^^*' represent the 
regions where the system is in contact with the p-th ther- 
mostat. 

The following model for a heat conducting and elec- 
trically conducting gas is a good example of the above 
general situations, [24, 25]. In a box B C B? (its dimen- 
sions are arbitrary and the shape is drawn in the follow- 
ing figure), are enclosed N particles with mass m = 1, 
interacting via a rather general pair potential, like a hard 
core potential with a tail or via a Lennard Jones poten- 
tial, and they arc subject to a constant force field [electric 
field) Eu in the x direction; the particles also collide with 



fixed obstacles so arranged that no coUisionlcss straight 
path can exist. The boundary conditions are periodic 
in the horizontal direction and reflecting in the vertical 
direction. 

Adjacent to the box B are located two boxes TZ+,TZ- 
containing Af-|_ = iV_ = N particles interacting with each 
other via a hard core interaction, and with the particles in 
B via a pair interaction with suitably long range (shorter 
than the distance between the two boxes), but are sepa- 
rated from the latter by a reflecting wall. The sizes and 
the location of the three boxes can be changed and they 
are flxed only for deflniteness. 




Fig.l: The horizontal container heis periodic boundary con- 
ditions; the two additional containers enclose the thermostat- 
ting sytems. On the container act an constant force estab- 
lishing a particles flow while the temperature difference of 
the thermostats induces a heat flow producing a situation in 
which Onsager reciprocity is expected to hold in the limits 

£; -> 0, e+ - 9- ^ 0. 

We imagine other forces to act on the system and en- 
forcing the following constraints: the total kinetic energy 
in the "hot plate" 7^+ and in the "cold plate" TZ- are 
constrained to be ^NkBQ+ and, respectively, ^N-ksQ- 
whcre 9_ and 9+ — 9_ + (59, ^9 > are the tempera- 
tures of the plates: see Fig.l. 

The equations of motion are, if Fj are the impulsive 
forces due to the hard cores plus the interparticle forces 
between the paricles in the regions TZ± and those in B: 



2, 



F.j +ExB{q.)u - a+ 



-3 ■ '^"--Ly 

+x+{q Jq, -ol-X- 



(9) 



where xb-,X± are the characteristic functions of the re- 
gions B,TZ± and a+a^, are multipliers deflned so that 
for some preassigned 9±: 



(10) 



are exact constants of motion. 

Let Le,L+,L-,L^,L^ denote, respectively, the work 
per unit time performed by the fleld E or by the particles 
in the thermostats , TZ- on the gas in B, or by the gas 
in B on the thermostats TZ+ , TZ- . 

We suppose that the interaction between the particles 
in the thermostats TZ± and the ones in the m,a,in box B 
are strong enough (compared to the field strength) so that 
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a stationary state is achieved and the chaotic hypothesis 
becomes, therefore, meaningfuL In fact it would be inter- 
esting to find a proof that one can really build a model in 
which this happens: I think that the assumption should 
hold if E is small and the particles in TZ± have a suf- 
ficiently long range interaction with the particles in the 
box TZ and sufficient strength; possibly even with no such 
extra condition in the cases E = (pure heat conduction 
models). Otherwise in order to be sure that a stationary 
state is reached one should add some further constraint, 
e.g. impose that the total energy in the main box stays 
bounded: the discussion that follows would not change 
substantially, as discussed in detail in [24]. 

Let jCe,^+,^-,^+,^- be the time averages of the 
above works. 

Let Q± the work done per unit time by the thermostats 
forces in the regions TZ± and Q± their time averages. 
Then the imposed conservation laws give, in a stationay 
state, 

£b + £+ + £_ - £° - >C° = 
-Q+ + Cl-C+=0, -Q_ + £0 - £_ = (11) 

so that one finds (by differentiating (10) with respect 
to time and by applying the equations of motion (9)) 
expressions for a+,a_: 



a± = 



Q± 



.• 2 



(12) 



and the phase space contraction per unit time, i.e. kg^ 
times the entropy production per unit time, is: 

a{x) = (37V- l)(a+ + Q!_) 

in the configuration x with average (for large A'''s) 



a = 



S- 



kB&+ ksQ- 



> 



(13) 



Note that Q+ + Q_ = if = (hence jCe = 0) and 
Q+ > 0,Q_ < 0. 

The example shows that the considerations of the pre- 
vious sections can be extended to the much more gen- 
eral cases considered above in which the forcing is due 
also to velocity dependent forces. They also give more 
grounds to the identification of the entropy production 
rate with the phase space contraction: see equation (13) 
when E = 0. 

Remarks: (1) It is useful to stress that in the above model 
the SRB distribution is concentrated on a zero volume set 
in phase space: however if one looks at the restriction of 
the SRB distribution to the particles in the main box 
B, i.e. to their statistical properties, then it should be 
given by a density in the restricted phase space: the basic 
mechanism for this has been discussed and clarified in an 
interesting class of models in [49]. 



(2) Note that according to the definitions of Sec. Ill if 
E = there is no external positional force acting on the 
system and therefore the corresponding work W vanishes 
(and W = Qi + Q2 = 0). So the effective temperature 
is 0: this is quite a surprising consequence of the defini- 
tions which may mean that the definiton of temperature 
proposed in Sec. Ill is not appropriate. However this is 
effective temperature of the combined action of the two 
thermostats, a notion that is new. At the same time we 
see that the temperatures of the individual thermostats 
are naturally identified with ©_)_ and 0_ if they are de- 
fined, as in Sec. Ill, by the ratio between the average 
work done by a thermostat force divided by its average 
contribution to the phase space contraction times ks- 

VII. Remarks. 

(1) The above analysis, if accepted, allows us to de- 
fine entropy as a notion related to heat exchanges only 
for the stationary states which are in the very special 
class of equilibrium states. It is however important and 
appropriate to mention one more study that has been 
made in the attempt of defining entropy as a function of 
nonequilibrium stationary states. 

One can consider an evolution of a phase point un- 
der forces which up to time ti are constant and admit a 
stationary SRB distribution /z^ , then the forces vary be- 
tween ti and t2 and become again constant after time t2. 
during the whole process we imagine to keep the ther- 
mostatting force varying so that the "temperature" of 
the thermostats, as defined in Section III remains con- 
stant. If one fixed the forces E_{t) at their value at any 
t G [^1,^2] then the dynamics would admit a SRB distri- 
bution. Therefore we can define for each t the stationary 
SRB distribution Jtf corresponding to the "frozen" forces 
E_{t) and, at the same time, the (different) probability 
distribution /ij into which ij} evolves in the time interval 
[t^,t], and we can also define a{T) = J ar{x)^r{dx) and 
o't = J ar{x)'p^{dx). 

Then a quantity which is possibly of interest is 



rt2 

ks I {o- 
Jti 



{t) -ut)dt 



This is a quantity that does not really depend on how 
long a time the system dwells on a special value of the 
parameters since the integrand will go to zero fast if the 
interval is too long (because /it will approach /ij- 

Does / depend on the intermediate stationary states of 
the transformation? Some aspects of the question have 
been partially studied, [50], and I interpret them as sug- 
gesting that to first order in the variation of the force pa- 
rameters (during the intermediate times) independence 
might hold (I stress that this is a conjecture). More pre- 
cisely: if the variation of the forces vanishes rapidly at 
—ti, t2 = +00 (hence the evolving distribution /i/, returns 
to /z^ and the system performs a cycle) then the value of 
I does not depend on the actual intermediate pattern 
of the variation of the forces, to first order in the varia- 
tions. It is tempting to think that the quantity / could 
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be interpreted as entropy variation of the system in a 
transformation of the initial into the final state. How- 
ever, the same work suggests that very likely this is no 
longer true already to second order: going in the direc- 
tion of making difficult alternative attempts at defining 
entropy variations in stationary nonequilibria on the ba- 
sis of the quantity /. This is a point that is likely to be 
clarified in the near future. 

(2) Having defined the notion of entropy production 
rate one can define a "duality" between fiuxes Jj and 
forces Ej using a{x) as a "generating function" : 



which, at _E = 0, leads to Onsagcr's reciprocity and to 
Green Kubo's formulae for transport, [24 26]. 

(3) We have proposed a definition of entropy produc- 
tion rate and of temperature for a class of stationary 
states. But a new definition is really useful if it is associ- 
ated with new results: I think that such new results may 
already be around and many cluster around the fluctu- 
ation theorem. I refer, on this point, to the literature, 
[2, 3, 5, 21, 51-55] confining myself here to recalling the 
theorem. This is a theorem that holds for systems me- 
chanically thermostatted by a thermostat which is time 
reversible, i.e. such that there is an isometry map / of 
phase space such that = identity and which anticom- 
mutes with the identity, namely ISt — S-tl. 

For instance the model in Sect. VI is time reversible, 
and time reversal is simply I{q , q) = q , q). 

Suppose that > (see Section HI) and let the aver- 
age "dimensionless" entropy production rate over a time 
interval r be Pt{x) = T^^a~^ a{Stx)dt. Then the 
SRB probability tTt- [p) dp that the dimensionless entropy 
production rate is Pt{x) G [p,p + dp] is related to the 
probability Trr{—p) dp by the relation "FR" 

7rr(-p) 

where the error term O is uniformly bounded for all 

T ^ oo, and for all \p\ in a fixed closed interval con- 
tained in [0,p*), where 1 < p* < oo is a suitable constant. 
The constant p* is a non trivial dynamical quantity, see 
[56] where it is defined; nevertheless it has sometimes, 
even recently, been confused with the maximum value of 
(t(.t)/(T. with consequent misimderstandings: in general 
max |(7(a;)|/c7 > p* and it can be even much larger, [57]. 

The FR can be more clearly formulated in terms of the 
function C,{p) = lim^^oo ^ogT^rip) and it becomes 

C(-p) = C(p) - o-p, \p\<p* 

with no error term because this is a relation valid in the 
limit T ^ oo. It is important to note that while 17(0;) 



is not an intrinsic quantity, as it depends on the volume 
definition hence on the metric used on phase space, the 
a as well as the function are independent on the 

metric used and are intrinsic quantities. If one changes 
the metric, say by altering it by a factor then the 

variation of a[x) is C'^{x) where C is the Liouville op- 
erator: hence the quantity t^^ a{Stx)dt changes by 
the variation T^^{^{Srx) — ^{x)) which tends to as 
r 00. 

In the latter form the FR relation can be also regarded 
as valid for allp if we imagine that for \p\ > p* the func- 
tion (^(p) is defined to be equal to —00. Indeed it is nat- 
ural to define ({p) = —00 for \p\ too large, certainly for 
\p\ > maxx \a{x)\/a, because such values are impossible; 
the value of p* above can in fact be determined, if one 
follows the details in [5, 56, 58], by the condition that 
dp) > for \p\ < p*. The value of for P = P* 
is a delicate matter: one can only say that the func- 
tion ((p) has to be convex, so that if it is well defined 
for p = p* it can have a priori any value between the 
limp<p. _ p_>^. ({p) and —00: it is likely that the answer 
is model dependent. 

A way to interpret the FR for o" = is to consider it for 
E_ and to look at the limiting relations that it im- 
plies when the forcing ^ ^ , hence cr — > 0. As such it 
is very interesting, and properly interpreted leads to On- 
sager reciprocity and Green-Kubo formulae for transport 
coefficients in the limit of zero forcing: hence the FR can 
be interpreted, in reversibly thermostatted systems, as 
an extension to non zero forcing of Onsager reciprocity, 
[24]. 

As an example the fluctuation relation should hold for 
the models in Sec. VI: and it would imply the usual On- 
sager reciprocity and Green-Kubo relations in the limit 
in which 6+ — 0_,i?^Oas discussed in [24]. 

One might be interested in seeing what the above re- 
lation becomes in the case; of ciquilibrium states or more 
generally in the cases in which a = 0. An answer would 
be that it makes no sense because the very definition of 
p involves division by 0. 

A related question would be to ask which are the prop- 
erties of the quantity A{x) = JJ" a{Stx) dt, i.e. of the 
dimensional entropy creation rate: but it would be un- 
interesting because one would just find that if we call 
C{A) the function analogous to C then C(~^) = C(^) for 
\A\ = (which is of course trivially true, see also below). 

Nevertheless one might think that the proof of the FR 
in the cases a > could be followed (in the case of Anosov 
systems) with minor adaptations to obtain some non triv- 
ial result even in the cases ct = 0, [57]. Closer examina- 
tion of this point can be traced back to the remark that 
even in (Anosov) equilibrium systems one could have a 
a{x) ^ 0: in fact the value of a{x) is identically zero in 
equilibrium systems only if one uses the natural metric 
on phase space, whose volume element is the Liouville 
volume. If one used a different metric or if one imposed 
some constraint like constant kinetic energy then (t(x) 
might be non zero: and it will be so in general. However 
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in such cases the phase space contraction would be only 
apparent: in fact one can show that a{x) would have 
the form a{x) = CF{x) with C the Liouville operator 
and F is a suitable function. Or, in the case of dis- 
crete time evolution S, the phase space contraction (j{x) 
would take the form cr{x) = F{Sx) — F{x), see proposi- 
tion 6.4.3 in [14]. So that A{x) = t''^ A{Stx) dr = 
T^^{F{Srx) — F{x)) r^oo' and the FR would become 
trivial because the distribution of A becomes a delta fun- 
tion at the origin. If one follows the proof of the FR, 
[56], under the additional assumption a = and with 
the appropriate modifications one ends up, if mistakes 
are avoided^ [57] , with a trivial statement that FR holds 
for p = only. 

Forgetting or misinterpreting the restrictions of valid- 
ity for the FR {i.e. p < p* oy \A\ < p*a) as well as 



neglecting the problems arising in its intcprctation for 
the distribution of A in the cases a = has led to a va- 
riety of mistakes, paradoxes and logical errors, [57]. In 
fact in applications taking the restrictions into account 
is essential, see for instance [59]. 
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